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Abstract. We generalize the orthonormal basis for the Gaussian RKHS de- 
scribed in [3| to an infinite, continuously parametrized, family of orthonormal 
bases, along with some implications. The proofs are direct generalizations of 
those in [3]. 



1. Main Results 

Notation 1. Let a = (ai,...,a„) G (NU{0})", |a| =Ej=iaj; 2;" =a;iV..<", 
and = ^ ^ I , the multinomial coefficients. Also, by writing U\X), dx, we 
assume that the Lebesgue measure is being used. 

Theorem 1. Let X C M" be any set with non-empty interior. Let K{x,t) = 

\x — t\ 1^ 

exp(— ). Let c G M" be fixed but otherwise arbitrary. Let Hk be the RKHS 
induced by K . Then dini('H/f ) = 00 and 



The inner product ( , )k on Hk is given by 

00 , . 

ft! ■r-^ WaVa 

\\x — c\\^ ||x-c||^ 

for f = e E 1^1=0 ^"(2; - c)",.g = e E|^|=o^'a(2^ - c)"^ e Hk. A 



'I 

oHhonormal basis for Hk is 



n 



(2) = V^T^^"^(^"^)">H=M=o- 

Remark 1. By varying c through R", we obtain a continuously parametrized family 
of orthonormal bases ofT-Lx - there are uncountably many of them. In particular, for 

c — 0, we obtain the orthonormal basis {(j)a{x) = \f^^^^^^^ ^°^}'\^\=k k=0' 
already described in _4_ and [3 . 

Let us discuss some immediate implications of Theorem[T] Consider the function 
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Corollary 1. For any c € M" and any set X C M" with non-empty interior, 
0o,c e HK.aiX), with 

(3) ||0o,c||w,^,„(^, = 1- 

To illustrate the result of Corollary [l] we note that by Aronszajn's Restriction 
Theorem (see [1], section 5), for any set X C K", 

(4) UkAX) = {/ : X ^ M I 3F e UkA^") ■ / = F\x}, 
with corresponding norm 

(5) WflW.Ax) = min{||i^||„,,„(„„) : / = F\x}. 

In particular, this implies that (t>o.c{x) — exp (^~^^^^t^^ G T~LK,a{X) for all c € M", 
with norm 

(6) ||</'o.c||hk,<,(x) < ll'/'o,c||wjc„.(R") = \\Kc\\hk,A^") = 1- 
In particular, for c e X, we have 

(7) ll</'Ox||ff,^.„(X) = WKcWukAX) = 1- 

Remark 2. W^e zwis/i to emphasize that one can only write (f>Q_c{x) — exp ^—^-j^z^^ 

Kc{x) when c e X; t/ie function exp ^—^^^^5^^ is always defined on any X C M" 
and /or an^/ c G M" , &Mi we cannot talk about Kc if c ^ X . Thus the Restriction 
Theorem only allows us to conclude that \\4'o,c\\hk ^(x) 1^ 1 when c ^ X. 

The power of the Orthonormal Basis Theorem (Theorem [3]) is clearly illustrated 
in the proof of Theorem [TJ Note that there is no need for us to consider the larger 
set R" or embedding maps between HK,a{X) and Hk,<j(S.'^)- We automatically 
have 0Q_c S T~LK,cr{X) without having to invoke the Restriction Theorem. 

Theorem 2. Let X C M" he any set with non-empty interior. Let K{x, z) = 

exp(— -Ll^-^^^JJ-). Let c G R" be arbitrary. The Hilbert space T-Lk induced by K on 

X contains the function exp(— ^^^^^^"^^^ ) if and only if Q < fi < 2. For such ji, the 
corresponding functions have norms given by 



exp 



f-\ F ~ c| 



2 



■Hk.^(X) 



1 



/i(2 - /i) 



In [3], it it shown that /o(x) exp(-^^l^) G HkA^) if and only if < < 2. 
If X = R", then it follows immediately from the translation- invariant property that 

fc{x) — exp(— ^^^^2^) G 'H-K.a{X) if and only if < < 2. Specifically, in terms 
of the Fourier Transform, 



(27r)"(cr0F)" 



1 



|2 



\i X ^ R", the Restriction Theorem gives 

\\fo\yiiK,„{x) < II/c||h^_,(R'.)- 
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So if < /i < 2, then we can conclude that fc E HK,a-{X). But we cannot say more 
about ||/c||^^ (X)- cannot make a statement on the reverse direction either: 
if fc G 'H-k,<t{X)^ we cannot infer that < < 2 using the Restriction Theorem. 
This is what Theorem [2] gives us. 

2. Proofs of Main Results 

2.1. The Weyl Inner Product and Orthonormal Basis of the Gaussian 

RKHS. Let us prove Theorem[TJ It was shown in 2^ that for X = R", n e N, and 
K{x, t) = {x,t)'^, d E N, we have Hk = ^d{^"), the hnear space of all homogeneous 
polynomials of degree d in R", with the inner product ( , ) being the Weyl inner 
product on Udi^"): 

{f,9)K = 2^ -j^. 

\a\=d " 

for / = E|a|=d^"^"' 9 = Elahd"""^" e '^K- 

Theorem 3 (Aronszajn). Let H he a separable Hilbert space of functions over X 
with orthonormal basis {</'fe}feLo- H is a reproducing kernel Hilbert space iff 

oo 
fc=0 

for all X E X . The unique kernel K is defined by 

oo 

K{x,y) = ^(/)fe(x)^fc(?/). 

fe=0 

Proof of Theorem\l[ Wc will show that the inner product (, )k in Hk is simply 
a generalization of the Weyl inner product for the homogeneous polynomial space 
?^rf(M"), d E N. Consider the following expansion 

r., , / \\x-t\\^\ f IKX-C)- (t-C^I|2 

K{x,t) = expi-^ -ii- =exp' ; v , 



k=0 \a\ = k 



Let ffo = {/ = e J2Z\=o^o.ix - c)" \ E^o (2/5^ E|a|=fe cf < ^O"" 



11=1=- 



/ G Hq, 9 = e °^ X]|^|=o '^aix — c)" G Hq, wc define the inner product 
(/: 9)k,o = 'l2k=o 727ff2W Eiq 



k=0 (2/0-2)'= Z^\a\=k ■ 

Let us show that Hq is itself a Hilbert space under ( , )k,o- For simplicity let n — I. 
Then 

Ho = {f = e-^^Y,Wk{x-c)''\ ^___w;2<oo}. 

It is clear that Hq is an inner product space under ( , )k,q- Its completeness 
under the induced norm || \\k,o is equivalent to the completeness of the weighted 
£2 sequence space 

€ = {{wk)T=o ■■ \\{wk)T=o\k = (E (27^^')'^'}' 
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which is itself a Hilbert space. Thus {Hq, \ \ \\k,o) is a Hilbert space. 

If X C M" has non-empty interior, then the monononiials (x — c)", |a| > 0, are 
all distinct. It follows from the definition of the inner product ( , )k,o that the 
4>a,cS, as given in ([2]), are orthonormal under ( , )a',o- Since = spanlc/ic^cla, it 
follows that the 0q,c's form an orthonormal basis for [Hq^ \\ ||a',o)- By Theorem[3] 
and the relations 

E^oE|a| = fc'/'a,c(a;)0a,c(t) = K{x,t), 

JlkLo E|a|=fc l'/'a,c(a;)|2 = K{x, x) = 1 < oo, 

it follows that {Hq, \\ \\k.o) is a reproducing kernel Hilbert space of functions on X 
with kernel K{x,t). Since the RKHS induced by a kernel if on a set X is unique, 
we must have [Hq, \\ \\k,o) = (Uk, \\ \\k)- □ 



Proof of Theorem \^ Let us first consider the case n = 1 . Then 



2 oo oo 2ki,\ 



fc=0 fc=0 



Consider the function e , which is 



cr2fcA:! 

fc=0 



Thus W2k = ' ^M^J^^ and w-j = for j ^ 2k. Then 



If /i < or /i > 2, then 



fc=0 fc=0 ^ ^ fc=0 ^ ' 



^ 22fe(fc!)2 -A^22'=(fc!)2 °° 

showing that f ^ Hk in those cases. If < < 2, then 

f. (M-l)2fe(2fc)! ^ ,, (2fc-l)!! 
A. 22'=(fc!)2 ^1 (2^)!! 

which converges by the Ratio Test. Hence we have X^feLo ^'W^^k showing 
that e S "Ha for < /i < 2, with norm 

„^_M^I|2_g(A^-ir(2fc)! 1 1 



/c=0 

For any n G N, we have 



^ ^ 22'=(fc!)2 VI v/M2^' 



^ oo n 

;^ — 



{fci,...,fc„}=0 i=l 
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giving us 

oo n 2ki I. I " =c 2ki r, | 

lie ^^11;^= 2^ [[^k-^k,=[[2^^k-^k,- 

{fei,...,fc„}=Oi=l i=lfci=0 

The result then follows from the one dimensional case above by symmetry. □ 
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